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ABSTRACT 

Diagnostic errors are a major patient safety 
concern. Although the majority of diagnostic 
errors are partially attributable to cognitive 
mistakes, the most effective means of improving 
clinician cognition in order to achieve gains in 
diagnostic reliability are unclear. We propose a 
tripartite educational agenda for improving 
diagnostic performance among students, 
residents and practising physicians. This agenda 
includes strengthening the metacognitive abilities 
of clinicians, fostering intuitive reasoning and 
increasing awareness of the role of systems in 
the diagnostic process. The evidence supporting 
initiatives in each of these realms is reviewed and 
a course of future implementation and study is 
proposed. The barriers to designing and 
implementing this agenda are substantial and 
include limited evidence supporting these 
initiatives and the challenges of changing the 
practice patterns of practising physicians. 
Implementation will need to be accompanied by 
rigorous evaluation. 

INTRODUCTION 

Diagnostic error is well established as a 
major cause of patient harm. With the 
rate of missed, incorrect or delayed diag- 
noses estimated to be as high as 10% to 
15%/ 2 diagnostic error may result in 
over 40 000 deaths annually in the USA 
alone. 3 In addition, because diagnostic 
errors are not easily identifiable as 
'events', they are difficult to track and are 
likely under-reported. Although relatively 
neglected within the field of patient 
safety, there are increasing calls for 
improvements in diagnostic reliability. 3-5 
Suggested interventions for improving 
diagnostic safety have primarily centred 
on the development of systems-based 
approaches such as clinical decision 
support systems and electronic medical 
records. ~ 8 Although systems-based inter- 
ventions may remedy or mitigate some 
cognitive errors, 3 these efforts will need 
to be coupled with improvements in the 



cognitive performance of clinicians to 
achieve significant improvements in diag- 
nostic reliability. 

Over the past decade, there has been 
increased interest in teaching clinical rea- 
soning during medical training in order to 
equip novice clinicians with the basic skills 
necessary to become competent diagnosti- 
cians. 5 9-11 The best approach for teaching 
clinical reasoning and the extent to which 
biomedical instruction should be sup- 
planted or supplemented by clinical rea- 
soning instruction (acknowledging the 
fundamental role content knowledge plays 
in reasoning) are unknown. In this article, 
we propose an educational agenda for 
increasing diagnostic reliability among trai- 
nees and practising physicians. This agenda 
is delineated into the three general themes: 
improving metacognitive abilities, develop- 
ing non-analytical (intuitive) capabilities 
and increasing systems awareness. We aim 
to describe the rationale for the develop- 
ment of educational programmes in each 
of these realms, review the currently avail- 
able evidence and suggest potential areas 
of innovation and study. 



Metacognition 

The dual process model of clinical rea- 
soning emphasises the interplay between 
intuitive reasoning (a rapid and uncon- 
scious application of previous knowledge 
and experiences, triggered by environ- 
mental cues, into decisions and actions) 
and analytical reasoning (a conscious 
approach to solving a problem with 
extended or deliberate analysis) in 
making diagnoses and solving problems 
in clinical settings. 12 Metacognition is the 
analytic practice of explicitly examining 
one's thought processes and affective 
state and considering their effects on 
diagnostic reasoning. 13-15 Teaching diag- 
nosticians 'how doctors think' and enhan- 
cing their understanding of cognitive 
pitfalls and biases may allow clinicians to 
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devise cognitive forcing strategies (structured methods 
of recognising and counteracting heuristics and biases) 
to limit the influence of these biases on the diagnostic 
process. 14 16 17 

To date, there is little evidence that explicitly teach- 
ing the mechanics of the clinical reasoning process 
can improve diagnostic performance. 18 19 Sherbino 
et al, 10 for example, examined the utility of cognitive 
forcing strategies as a means of overcoming search 
satisficing and availability bias. No long-term effect 
was seen, although the intervention was limited in 
scope. Mamede showed that the tendency towards the 
availability bias could be partially attenuated in resi- 
dents through the use of conscious reflection struc- 
tured as a reanalysis of the case findings. 21 Finally, 
Ogdie showed that residents who are taught about 
cognitive biases can successfully reflect on the role of 
bias in their own experiences, but the actual effect on 
diagnostic performance was not assessed. 22 

An inherent weakness of these debiasing approaches 
is that they target the same human tendencies to think 
and problem solve in a certain way (also termed cogni- 
tive predispositions to respond) that often results in 
the correct diagnosis. 19 Furthermore, novices may 
benefit from different cognitive developmental pro- 
cesses than experts. 23 Given the paucity of evidence 
but underlying logic of this approach, we propose that 
clinicians should be instructed in the basic process of 
clinical reasoning (such as the interplay between ana- 
lytical reasoning and intuitive reasoning and the 
strengths and weaknesses of heuristics) and that 
further interventions that promote metacognitive tech- 
niques such as cognitive forcing strategies be designed 
and implemented and their impact carefully studied. 
The net effect of these forms of interventions will 
likely be dependent on a number of variables specific 
to both learner and content. It is probable that the 
best approach to designing interventions is the one 
that reflects the underlying complexity of the clinical 
reasoning process and acknowledges there is no one 
'best practice'. 18 

Fostering intuition 

Although the medical decision making, evidence- 
based medicine and clinical reasoning literatures gen- 
erally favour analytical reasoning over intuitive rea- 
soning, modern neuroscience recognises the dynamic 
interplay and cross-checking between the intuitive 
(system 1) and analytical (system 2) cognitive systems 
in the dual process model and, in some cases, the 
superior performance of intuition. 24 An emerging 
body of medical education studies in varied domains 
(eg, electrocardiograms and mental health disor- 
ders) 25-27 encourages medical educators to promote 
the development of intuition among trainees. 

Specific methods to develop and promote intuitive 
reasoning can be derived from a synthesis of the learn- 
ing, judgement/decision-making and expertise 



literatures. These approaches are similar to the mental 
training on the job and outside of work that underpins 
naturalistic decision making. 28 As detailed below, 
several approaches can be used to strengthen learners' 
intuitive skills on their own, with the help of a dedi- 
cated coach, or through a curriculum or organisational 
culture. Teachers must also help trainees develop their 
metacognitive skills to recognise clinical situations 
when intuition can be relied upon and when it must be 
abandoned for or buttressed by analytical reasoning. 

Progressive problem solving 

Progressive problem solving describes the mindset of 
professionals who avoid the routinisation of work (eg, 
'yet another case of pneumonia') by creating chal- 
lenges that increase the cognitive burden of the 
encounter even when the circumstances do not 
require it. Top performing professionals pursue this 
approach (eg, precontemplating an algorithm if the 
pneumonia fails to respond to doxycycline) in an 
effort to train their minds (ie, sharpen intuition) for 
future encounters. 29 Sargeant found that highly rated 
(by 360° evaluation) physicians maintained this dual 
purpose mindset of taking care of patients, focusing 
on patient outcomes while habitually generating learn- 
ing. 30 Mylopoulos similarly confirmed that high- 
performing diagnosticians build their knowledge 
through purposeful, continuous engagement and 
learning in clinical practice. 31 

Feedback 

In the current training environment, only a minority 
of decisions are coupled with patient-outcome feed- 
back (eg, "did the patient I assessed as low risk for 
coronary artery disease ultimately have coronary 
artery disease?"). This amounts to the forfeiture of 
multiple opportunities for learning and judgement 
optimisation. Feedback is a cornerstone of the deliber- 
ate practice model of skill development, where prac- 
tice is focused upon a high-value task and regular 
feedback is used to close the gap between current and 
goal performance. 32 Although the documentation of 
feedback leading to improved diagnostic performance 
is limited to a small number of studies, 33 34 clinicians 
should consider how their learning could mirror that 
of other high accuracy professions which are charac- 
terised by copious direct feedback. 35 

Simulation 

The intuitive system is developed and refined through 
experience, but there is a limit to the number of 
patients and hours that a clinician can be exposed to 
in the workplace setting during training or over a 
career. Simulation exercises, however, can broaden a 
learner's experience base and serve as a reference in 
future patient encounters. Free cognitive simulators 
abound in the form of on-line and journal-based case 
reports. Virtual patient experiences have been shown 
to enhance reasoning skills, 36 although there is no 
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data to demonstrate a reduction in diagnostic errors 
through this approach. 37 

Summary 

In dynamic fields analogous to medicine where 
complex knowledge and judgement are required (eg, 
firefighting and military), experts are superior 
problem solvers who possess a large and rich reper- 
toire of mental models (ie, illness scripts in medicine) 
of the problems they face at work. 38 Trainees and 
their teachers, supported by curricula and institutional 
culture, can strengthen these illness scripts by increas- 
ing the quantity and quality of clinical experience 
through the methods described above, which amount 
to mental training derived from current encounters in 
preparation for future problem solving. These 
approaches to improve intuitive reasoning have great 
potential in medical education, but require careful 
development and research to determine if they can 
fulfil their promise. 

Systems-level awareness 

A systems view of diagnosis regards clinical reasoning 
as a cognitive process that is dependent upon a 
number of external factors that impact the ability to 
gather information, acquire tests and imaging, inter- 
pret results and communicate with others. From an 
educational perspective, a systems approach to teach- 
ing diagnostic skills must equip learners with the 
knowledge, skills and attitudes to interact with people 
and processes to make a reliable diagnosis. It should 
also include instructions on how to recognise and 
compensate for imperfect systems that hinder optimal 
decision making. 

Knowledge of systems 

The essential message of teaching about systems is 
simple, yet rarely acknowledged in medical education: 
the ability to make a diagnosis relies on a host of 
factors largely outside one's immediate control. The 
ability to recognise system flaws, compensate for them 
and work to continually improve the process is vital. 
A review of Reason's Swiss cheese model provides 
basic introductory content. 39 There is additionally a 
growing literature base of potential system interven- 
tions to support the cognitive work of diagnosis that 
will likely offer new ideas and strategies to teach for 
future improvement. 7 

Systems-based skills 

Trainees and clinicians can learn about diagnostic 
failure by investigating and analysing real-world cases. 
A variety of different frameworks and tools are avail- 
able to facilitate analysis, some of which are specific 
to settings or specialties. 40 ^ 5 The ability to critique 
cases, identify contributing factors, map the diagnostic 
process and recognise problems and potential sources 
of error can provide opportunity for learning and 
strategies for improvement. Case conferences and 



bedside teaching can be modified to include discus- 
sion about systems factors that impair the flow of 
accurate information and predispose patients to 
misdiagnosis-related harm. Morbidity and mortality 
(M&M) conferences, in particular, may be an ideal 
format for discussing diagnosis failure and the 

addition of a structured, systems-oriented tool can 
facilitate recognition of system flaws. 53 At one institu- 
tion, the addition of a structured 'system audit' to 
M&M investigations improved awareness of system 
issues and made residents more aware of opportun- 
ities for system improvement. 53 Conferences which 
address systems errors, however, should be balanced 
by discussions of cognitive error as an exclusive focus 
on systems may decrease the perceived educational 
value of the conference and has the unintended conse- 
quence of diminishing any one person's sense of own- 
ership or accountability. 47 55 

Systems-based attitudes 

The most significant part of educating about safety 
in systems is fostering an open attitude to discussing 
and addressing diagnostic errors, and promoting 
an environment that encourages engagement in system 
improvement. 56 57 Attitudes can be modelled by 
mentors, fostered by institutional culture and enhanced 
by opportunities for improvement projects. Success in 
changing a system is a powerful incentive, particularly 
for young trainees. Education should help the trainee 
recognise the need not only to achieve personal excel- 
lence, but also to think more broadly about extrinsic 
factors that limit his/her success. A systems perspective 
comes full circle: first viewing 'the system' as an inani- 
mate network of imperfect processes, and then recog- 
nising that the system is a complex network of talented 
resourceful individuals who need frequent readjust- 
ment and well-designed processes to effectively opti- 
mise care. 

IMPLEMENTATION 

Diagnostic errors are committed by medical students, 
residents and practising clinicians. Therefore, this edu- 
cational agenda is proposed for the selective applica- 
tion to all levels of medical professionals. Medical 
schools could provide basic instruction in the 
mechanics of clinical reasoning, and this training could 
be augmented and reinforced by initiatives designed 
for both postgraduate trainees and practising physi- 
cians. Graduate medical education, for example, could 
routinise discussion of common cognitive errors and 
the role of systems, while practising physicians could 
be incentivised or required by certification organisa- 
tions to demonstrate basic understanding of reasoning 
principles, diagnostic errors and continuous quality 
improvement of systems. A notable barrier to the 
implementation of these programmes is the lack of evi- 
dence that the proposed techniques and initiatives 
effect a clear improvement in diagnostic 
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performance. 37 This, however, is more reflective of a 
lack of investigation in this field than evidence suggest- 
ing these techniques are detrimental or ineffective. 
Rigorous and well-designed investigations, including 
randomised controlled studies, are required to deter- 
mine the effect of individual educational techniques on 
diagnostic performance. The effect of feedback on the 
performance of emergency department physicians in 
the evaluation of patients with chest pain, for instance, 
could be assessed by randomising one cohort to feed- 
back on patient outcomes. Similarly, the effect of 
instructing paediatricians in meta-analytical reasoning 
surrounding the diagnosis of acute otitis media could 
be assessed by tracking prescribing activity and patient 
outcomes. Finally, specific cognitive forcing strategies 
such as metacognitive checklists could be deployed in 
the primary care setting with careful measurement of 
the effect on diagnostic outcomes for common condi- 
tions like low back pain and respiratory infections. 

Competing curricular demands are another major 
impediment. Medical school and residency curricula 
are already overloaded and struggling with the inclu- 
sion of new initiatives in palliative care, team-based 
care and quality improvement. The insertion of 
another domain may be met with substantial resist- 
ance. Similarly, many practising physicians are chal- 
lenged by significant productivity pressures and 
state-mandated continuing education programmes, 
limiting the time that may be devoted to these 
methods. Finally, teaching many of these approaches 
requires faculty with a basic understanding of clinical 
reasoning, cognitive psychology and informatics. 
Faculty development is necessary to develop a cadre 
of educators with the necessary skill and experience 
to do so on a widespread basis. 

CONCLUSIONS 

Diagnostic unreliability remains a significant cause of 
error-related patient harm. Although initiatives 
designed to improve systems will be essential in elevat- 
ing diagnostic performance, enhancing the cognitive 
functioning of clinicians remains an equally important 
and perhaps more elusive goal. The current educa- 
tional model in which clinical reasoning expertise is 
developed passively has produced disappointing 
results. We propose that explicit instruction in the 
clinical reasoning process should begin at the earliest 
stages of medical school as a foundational 'basic 
science' and be strongly emphasised throughout the 
undergraduate curriculum. Building upon this basic 
foundation, this tripartite agenda for improving diag- 
nostic performance can be adopted by clinicians at all 
levels of experience. 

This agenda is rooted in the dual process model of 
clinical reasoning and serves to improve the function- 
ing of both intuitive and analytical processes. In devel- 
oping such complementary skills, clinicians will be far 
better equipped to deal with the complexity and 



difficulties of the diagnostic process. The agenda also 
emphasises the importance of the clinician's ability to 
interact with and influence healthcare systems in 
improving diagnostic performance. Knowledge of 
such systems and the ability to harness their potential 
in improving diagnostic performance should be core 
skills for all clinicians. 
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